Empirical Entropy Manipulation forReal - World
نویسندگان
چکیده
No nite sample is suucient to determine the density, and therefore the entropy, of a signal directly. Some assumption about either the functional form of the density or about its smoothness is necessary. Both amount to a prior over the space of possible density functions. By far the most common approach is to assume that the density has a parametric form. By contrast we derive a diierential learning rule called EMMA that optimizes entropy by way of kernel density estimation. Entropy and its derivative can then be calculated by sampling from this density estimate. The resulting parameter update rule is surprisingly simple and eecient. We will describe two real-world applications that can be solved eeciently and reliably using EMMA. In the rst application EMMA is used to align 3D models to complex natural images. In the second application EMMA is used to detect and correct corruption in magnetic resonance images (MRI). Both applications are beyond the scope of existing parametric entropy models.
منابع مشابه
Empirical Entropy Manipulation for Real-World Problems
No finite sample is sufficient to determine the density, and therefore the entropy, of a signal directly. Some assumption about either the functional form of the density or about its smoothness is necessary. Both amount to a prior over the space of possible density functions. By far the most common approach is to assume that the density has a parametric form. By contrast we derive a differentia...
متن کاملOrdinal Patterns, Entropy, and EEG
In this paper we illustrate the potential of ordinal-patterns-based methods for analysis of real-world data and, especially, of electroencephalogram (EEG) data. We apply already known (empirical permutation entropy, ordinal pattern distributions) and new (empirical conditional entropy of ordinal patterns, robust to noise empirical permutation entropy) methods for measuring complexity, segmentat...
متن کاملEntropy based Malmquist Productivity Index in Data Envelopment Analysis
Malmquist Productivity Index (MPI) is one of the most famous indices, which is used for estimating the productivity change of a Decision Making Unit (DMU) during the time. Virtually any empirical study that uses MPI, reports average of the productivity indices they estimate to represent the overall tendency in productivity changes. In such a case, productivity indices of a DMU are considered wi...
متن کاملComposable Deep Reinforcement Learning for Robotic Manipulation
Model-free deep reinforcement learning has been shown to exhibit good performance in domains ranging from video games to simulated robotic manipulation and locomotion. However, model-free methods are known to perform poorly when the interaction time with the environment is limited, as is the case for most real-world robotic tasks. In this paper, we study how maximum entropy policies trained usi...
متن کامل